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Abstract 

The lack of uniqueness arising by oversampling of Fourier coefficients is shown to 
' provide a way of transmitting hidden information. A basic encoding/decoding system, 

, developed on the basis of such a possibility, is discussed. The system is devised with the 

double purpose of: (a) enabling the transmission of an arbitrary signal and (b) allowing 
for the transmission of a hidden embedded code. 
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^ 1 Introduction 
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In a previous publication PP the oversampling problem of signal representation by Discrete 
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^ ! Fourier Transform (DFT) has been addressed from the Frame Theory point of view. 

^ I Within this structure the signal reconstruction appears as a tight frame superposition. As 
> 

' remarked in P, the implicit redundancy of frames is the cause of noise reduction in signal re- 
H , 

, construction and also the reason that the representation is not unique. In this communication 
we show that the lack of uniqueness can be used for dissembling information. 
We propose a basic encoding/decoding procedure, which enables the transmission of hidden 
information when transmitting some arbitrary signal. Although we shall restrict our consid- 
erations to redundancy arising by DFT oversampling, the proposal for transmitting hidden 
information could be equivalently implemented using any other redundant transformation. In 
particular, recently introduced techniques for the construction of tight frames OEIIZIIHI should 
be relevant to development of more sophisticated systems based on the principles proposed 
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here. Nevertheless, we feel it is appropriate to present the central ideas of this contribution 
by making use of the oversampled DFT. Among a number of important reasons leading to 
this choice we would like to point out the following: i)The Fast Fourier Transform (FFT), 
fast implementation of DFT, is still without doubt the most popular and widely used signal 
processing tool. ii)Oversampling FFT, by padding with zeros, is a common procedure for noise 
reduction and smoothing, hence the importance of stressing that it also leaves room for the 
transmission of hidden information. iii)All readers, regardless of their area of expertise, can 
be assumed to be familiar with the corresponding mathematical background. Consequently, 
we shall introduce the proposed technique within the framework arising by oversampling DFT 
coefficients. The effect of additive noise in the transmission channel is also considered. In order 
to discriminate the level of additive zero-mean noise in which the system can safely operate, 
two possible situations are analysed. 

The letter is organised as follows: In Section 2 the lack of uniqueness inherent to oversampling, 
as well at its relevance in relation to transmission of hidden information, are discussed. A 
basic DFT based encoding/decoding system is proposed in Section 3, and some examples to 
illustrate its performance in the presence of additive zero-mean noisy are given in Section 4. 
The conclusions are drawn in Section 5. 

2 Oversampling and lack of uniqueness 

Let us represent a signal f{t), which is defined for t e [— T, T], through its Discrete Fourier 
expansion, i.e. 
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Since for t G [—T, T] the complex exponentials in (P) constitute an orthonormal basis, the 
coefficients Cn in ^ are obtained as: 

cn = ^£/(t)e-^rft. (2) 

Let us consider now the re-scaling operation: t —>■ at, with a a positive real number less than 
1, and construct the functions ^^=e*^^, with Xt(^) deffined as: Xt(^) = 1 if t G [— T, T] and 



zero otherwise. The new functions ^^j=e^"'T' are no longer a basis but a tight frame for the 
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space of time limited signal with time- width T (the corresponding frame-bound being a~^ 
This has a remarkable consequence, namely the coefficients c„ of the linear expansion: 

m = ^t cne^^ (3) 

V ^-L 71= — oo 

are not unique. There exist infinitely many different sets of coefficients c„ which can reproduce 
an identical signal / by the above linear superposition. A particular set of coefficients Cn is 
obtained as: 



/T 
„ / X ^ annt . , . 

^f{t)e-'—dt. (4) 
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Out of all possible sets of coefficients, the ones given by the above equation constitute the 
coefficients of minimum 2-norm jSEl- 

Let us stress the cause for the coefficients in the tight frame expansion not to be unique. The 
reason being that, for a < 1 with the restriction t G [— T, T] the exponentials are not 

linearly independent i.e., we can have the situation: 

1 oo oo 

= E cy^=0 for Y: 141 VO 

n=— oo n=—oo 



or, taking inner products both sides with ^=^e' t 



2T" ' 



_ ^ c:,/^e-^e^^rft = for ^ 141 V 0, 



which can be recast in the fashion: 



Gc' = Q for \\c'\\^ = J2 |c^^lVO, 

n=— oo 

with G a matrix of elements: 

1 r'^ . amTvt . anTTt , Sill a(m — 71)71 , , 

W = ^ / e-^— e^— = ^ (5) 

and c' a vector of components c^. 

Notice that all vectors c' satisfying Gc' = belong, by definition, to Null(G), the Null space of 
G. All such vectors satisfy: 



oo 



■^-^ n=— OO y/ Zl „— y/ Zl 

where we have defined c/^ = c„+c'„ with c„ as in (jD) and c'„ the components of an arbitrary vector 
d G Null(G). Vectors c and d will hereafter be referred to as signal coefficients and hidden code 
coefficients respectively. The fact that all coefficients c" = c + d reproduce an identical signal 
as coefficients c provides us with the foundation to construct an encoding/decoding scheme for 
transmitting hidden information. 

3 The encoding-decoding system 

Let us assume that, in addition to transmitting an arbitrary signal /, we wish to transmit a 
hidden code h consisting of K numbers. For practical implementation we give to the oversam- 
pling parameter a a positive value, less than one, and consider that G is an M x M matrix of 
elements as given in We select K eigenvectors of G corresponding to the zero eigenvalues, 
which are assumed to be orthonormal, and construct a vector d G Null(G) as follows: 

d = UBS (7) 



where U is an M x K matrix, the columns of which are the K selected eigenvectors and Bg is 
a K X K unitary random matrix. Note: the subindex s indicates that the random generator 
used for constructing the matrix is initialized at state s. Such a state is needed to be known 
at the decoding stage. 

Encoding process 

Consider that the signal / to be transmitted is given as an iV-dimension data vector and proceed 
as follows: 

• Compute the signal coefficients c as in (jH). 

Note that this calculation can be carried out with Fast Fourier Transform (FFT) by 
adding ^'■^""^ zeros at the beginning and at the end of the data vector /, so as to obtain 
the required vector c of dimension M = ^. 

• Compute the hidden code coefficients c' as prescribed in 

• Transmit the coefficients c" = c + d to the receiver. 
Decoding process 

• Use the received vector c" for recovering the signal /. 

In practice this can be computed by Inverse Fast Fourier Transform (IFFT) on the received 
vector c". 

• Use the signal / to compute the signal coefficients c as in (0]), which can be accomplished 
by applying FFT on the signal / recovered in the previous step. 

• Compute vector d through d = d' — c. 

• Recover the hidden code h by noticing that: 
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(a) For constructing the matrix U one can use all eigenvectors of the matrix G corre- 
sponding to eigenvalues less than a previously specified tolerance parameter. Matrix U is 
unitary, i.e., — U* and then we have: Bgh — U*c', where U* indicates the transpose 
conjugate of matrix U. 

(b) The dimension of matrix Bg can be determined from the number of non-zero compo- 
nents of vector U*c'. Thereby, state s allows the reproduction of the random matrix Bg. 
Since this is also a unitary matrix Bg^^ = B*. 

— * 

Hence the vector h is obtained as: 

h = B;U*d. 

Remarks: In order to be able to implement the above described decoding process the re- 
ceiver should know: 

i) The transmitted vector c". 

ii) The oversampling parameter a, yet this parameter might be actually estimated in some sit- 
uations by counting the beginning/ending zeros apparent in the recovered signal. 

iii) The state s that was used for generating the unitary matrix Bg. Note: the restriction of 
unitariness is imposed in order to avoid amplification of errors in the inversion process. Such a 
condition is achieved by orthogonalization of a well posed random matrix. 

With the knowledge of i) ii) and iii) the receiver should be able to reproduce both the signal 

— * 

/ and the hidden code h. 
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4 Example 



Consider that we wish to transmit the chirp signal of Figure 1. In order to have an ac- 
ceptable representation of this signal we need N = 200 non-zero Fourier coefficients in the 
non-oversampled case (corresponding to considering a — 1). If instead we consider a — 0.5, 
we duplicate the number of coefficients used to represent the same signal, but it allows us to 

— * 

additionally transmit a hidden code. In our example we will send a code h consisting of K — 12 
numbers, the first 5 digits of which are shown in the first column of Table I. 

Case 1: If transmitted through a noise- free channel, the proposed encoding/decoding sys- 
tem is, of course, capable of transmitting a great deal of hidden information with accuracy 
fimited only by machine precision of the calculations involved. The absolute value of the coeffi- 
cients c conveying the information on the chirp signal are plotted in Figure 2a while the hidden 
code coefficients d are plotted in Figure 2b. The absolute value of the transmitted coefficients 

— * — * 

c" — c + d are those of Figure 2c. For the sake of avoiding a notorious distortion of coefficients 
c we have diminished the magnitude of coefficients d by multiplying by an appropriate scaling 
factor, which in the absence of noise can be arbitrarily small. As expected, our decoding system 
is capable of reconstructing the hidden code up to the precision of the numerical calculation, 
although for space limitation reasons we have shown only 5 digits (see the second column of 
Table I). 

Case 2: Now let us illustrate the effect of adding zero mean random Gaussian noise to the 
transmitted coefficients. As would be expected, the quality of the recovery of our signal and 
hidden code depends on the variance of the noise (cr^) relative to the size of the signal and 
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hidden code coefficients respectively. For this case and the following one was fixed such that 
the signal to noise ratio (in terms of the signal coefficients) was 40 dB. This allows a reasonably 
good recovery of the signal with a small amount of noise distortion. 

Now that the noise is fixed relative to the signal, we consider rescaling the hidden code coeffi- 

— * 

cients c' by a constant to achieve the desired accuracy in the recovery of the code. We define 
the variance ratio as 




c^||/Dim(c^)' 



where Dim(c') denotes the dimension of vector c'. In order to recover 4 significant digits of the 
code, we need a variance ratio of about 10~^ (see third column of Table I). To achieve such a 
ratio the magnitude of c' has to be increased, thereby the absolute value of the transmitted co- 
efficients look as in Figure 2c. It is important to remark that, although the need to magnify the 
coefficients c' makes them "visible" during the transmission, this has no effect whatsoever on the 
signal reconstruction. Let us recall that c' is by definition in Null(G'), so these coefficients can- 
not affect the signal in any way. Hence in this case the hidden code coefficients d actually play 
a double role. On one hand they cover the coefficients c conveying the information for recover- 
ing the signal / and on the other hand they convey the information containing the hidden code. 

Case 3: Let us finally discuss the hmitation of the proposed system if one does not want 
the hidden code coefficients c' to dominate the value of the transmitted ones c". With cr^ fixed 
as described in the previous case, the variance ratio was increased to 0.002 (by scaling c' ap- 
propriately) and the first digit of the code was still safely recovered(see the fourth column of 
Table I) . The absolute value of the transmitted coefficients in this case are shown in Figure 2d. 
Note that the transmitted coefficient are dominated now by the signal coefficients. 
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5 Conclusions 

Oversampling DFT has been considered as providing a means for transmitting hidden infor- 
mation. A basic encoding/decoding system has been discussed. The proposed scheme aims at 
transmitting an arbitrary signal and, simultaneously, embedding a hidden code. It is important 
to stress once again that the purpose was to discuss in the simplest possible way the possibility 
of using redundant transformations for embedding a hidden code while transmitting an arbi- 
trary signal. To such an end the idea has being presented in the context of DFT oversampling. 
However, many other redundant transformations could have been considered by an equivalent 
treatment. Furthermore, different ways of embedding a hidden code in the redundant coeffi- 
cients could be envisaged. We feel then confident that the simple scheme we have introduced 
here will stimulate further research in the subject. 
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Figure Captions: 



Figure 1: Chirp signal to be transmitted. 

Figures 2a-2e, from top to bottom. 2a depicts the absolute value of the signal coefficients 
used in all three cases, 2b the hidden code coefficients scaled as used in Case 1, and 2c the 
absolute value of the transmitted coefficients in Case 1. Figure 2d represents the absolute value 
of the transmitted coefficients in Case 2 and 2e the absolute value of the transmitted coefficients 
in Case 3. 



11 



code 


Case 1 
p = 


Case 2 
p = 10-5 


Case 3 
p = 0.002 


3.1492 


3.1492 


3.1496 


3.2286 


2.1271 


2.1271 


2.1270 


2.1157 


5.1312 


5.1312 


5.1316 


5.2206 


1.2835 


1.2835 


1.2836 


1.2939 


7.7976 


7.7976 


7.7979 


7.8660 


3.7160 


3.7160 


3.7164 


3.7999 


8.4139 


8.4139 


8.4140 


8.4360 


1.9791 


1.9791 


1.9791 


1.9885 


0.5863 


0.5863 


0.5868 


0.6785 


5.8321 


5.8321 


5.8317 


5.7570 


8.1032 


8.1032 


8.1032 


8.1124 


6.4908 


6.4908 


6.4907 


6.4718 



Table 1: Recovered code with given variance ratio. 
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Figure 
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